"The highlighted tokens are predominantly short function words, prefixes, or single letters from various languages, often marking grammatical relationships, verb forms, or serving as conjunctions and prepositions. These tokens are crucial for sentence structure and meaning, especially in morphologically rich or agglutinative languages."
Score Type | Accuracy | Precision | Recall | F1 score | TPR | TNR | FPR | FNR |
---|---|---|---|---|---|---|---|---|
detection | 0.55 | 0.527 | 0.98 | 0.685 | 0.98 | 0.12 | 0.88 | 0.02 |
fuzz | 0.57 | 0.538 | 0.98 | 0.695 | 0.98 | 0.16 | 0.84 | 0.02 |